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SUMMARY 



Problem 

In assigning officers to jobs, the Navy has a general management 
philosophy. An officer is expected to handle any management situation. 
General skills are regarded as more important than specialized training. 
This can mean that an officer may have several months of unproductive 
learning time before mastering the skills needed for a new assignment. 
If officers could be given a set of useful general problem solving skills, 
it is possible that this learning time could be shortened. , 

Objective 

t 

This research is a preliminary study with two major objectives. The 
first is to perform a literature survey of the problem solving and artifi- 
cial intelligence literature relevant to Navy needs. The second objective 
is to investigate approaches to problem solving that could be taught to 
Naval officers for use in their jobs. 

Approach 

This preliminary study is a literature survey and problem structur- 
ing effort. The study of problem solving is spread across many disci- 
plines, and the first step is to investigate this literature. 

Results and Conclusions 

This survey has found a growing interest in the area of problem 
solving. This interest began with work in cognitive psychology and 
artificial intelligence in the 1950's and gradually spread to influence ed- 
ucation and management. There is little evidence in the literature to 
indicate that teaching generic problem solving produces improvement in 
problem solving abilities. One factor complicating this is the lack of 
adequate definitions of problem solving skills and the lack of test in- 
struments to measure these skills. Some authors suggest that generic 
problem solving skills are best taught in the context more conventional 
courses. The work in teaching generic problem solving is still largely 
exploratory and unvalidated. 
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Future Research Considerations 



There is a need for both theoretical and applied research in problem 
solving. Topics of interest include: 

1. Design of measures of problem solving skills. 

2. Design of course modules in problem solving covering both do- 

main specific and general skills. 

3. Experiments where the usefulness of teaching problem solving 

skills is tested. 

4. Studies of computers and human problem solving. These should 

focus on the computer as a problem environment and ways in 
which the computer can aid human problem solving. 
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INTRODUCTION 



A long standing issue in problem solving is whether general prob- 
lem solving techniques offer a useful alternative to domain specific 
problem solving techniques. Early researchers in cognitive psychology 
and artificial intelligence concentrated on general problem solving 
[Feigenbaum and Feldman, 1963; Newell and Simon, 1972]. More recent 
work has dealt with knowledge based systems and expert systems which 
use these general techniques but apply them to specific prpblem domains 
[Barr and Feigenbaum, 1981; Barr and Feigenbaum, 1982; Cohen and 
Feigenbaum, 1982]. After thirty years of research, the issues are still 
far 'from being resolved. 

If generic problem solving skills can be successfully taught, this 
could be valuable in the education of Naval officers. Due to frequent 
personnel rotation. Navy officers are asked to solve problems and make 
decisions in areas where they have little initial knowledge of the subject 
matter. A useful set of generic problem solving skills could be of great 
benefit to the Navy and individual officers. These skills could be 
used to reduce the time required to get an officer up to speed in a new 
assignment. The idea of teaching generic problem solving skills is 

not new. Courses are in place at several universities, and there is a 
growing literature [Rubenstein, 1980; Hayes, 1981]. This work still 
must be regarded as preliminary, however. 

The objective of this study is to better understand problem classes 
and related solution strategies. To bound the requirement, we will fo- 
cus on the question of problem analysis instead of on specific problem 
solving skills in any domain. The most important step in any type of 
problem solving is to recognize and classify the problem. Only then 
can an individual bring specific problem solving techniques to bear. 

The approach taken will be to survey the literature in problem solv- 
ing, to develop a model of the problem solving process and to identify 
candidates for teaching and future research. In most courses, solution 
strategies are cognitively tied to the context in which they were 
learned. This can cause their applicability to other domains to be 
overlooked. Thus, the aim of any instruction in generic problem solv- 
ing is to get the problem solver to see solution techniques as general 
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methods that can be used in a variety of contexts. The hope is that a 
person who knows how to remove skills from a context will be a more 
successful problem solver in a variety of domains. 

One item of interest for follow on work is the extent to which dif- 
ferent modes of computer access can be helpful in structuring and solv- 
ing problems. Computers have great potential in aiding human problem 
solving. Some of the earliest work in artificial intelligence grew out of 
attempts by cognitive psychologists to simulate human problem solving 
processes on computers. This work led to increased understanding of 
both humans and computers. 



1.1 PROBLEM SOLVING AND NAVY CAREER PATTERNS 

A typical Naval officer's career is likely to involve rr|any different 
jobs and types of responsibility. The Navy is not a single monolithic 
entity but is divided into many different communities and warfare spe- 
cialties. Examples would include such areas as supply, surface war- 
fare, anti-submarine warfare, submarines, aviation and so on. An offi- 
cer's career begins in a particular community. Even within a 
community, there is wide variation in jobs. An officer may start in op- 
erational jobs and then move on to supervisory (e.g. department head) 
and managerial jobs (e.g. executive officer). At higher levels in the 
Navy, an officer may be transferred from the community. This kind of 
shift requires that abandoning the narrower perspective of the commu- 
nity and warfare specialty and instead viewing things from a Navy-wide 
perspective. 



1.2 THE STUDY OF GENERAL PROBLEM SOLVING 

Considering that human beings have been problem solvers for all 
their existence, the actual study of problem solving has a short histo- 
ry. Problem solving has been viewed as an art. You were either good 
at it or you were not. Little effort was made (or is being made) to 
teach problem solving as such. Most teaching is directed at domain 
specific skills. Examples of successful solution strategies are present- 
ed, and students are expected to emulate these strategies. 

An exception to this approach was Georg Polya's How to Solve It , a 
classic book of solution strategies for mathematical problems. Polya laid 
out the problem solving process as a series of steps. These are given 
in Figure 1. Polya's book offered many helpful examples for using this 
approach. The methods he used were actually quite general, but the 
domain was limited to mathematics. 
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1. Understand the problem. 

What is the unknown? What are the data? What is the 
condition? Draw a figure. 

Introduce suitable notation. Separate various parts of the condition. 

2. Devise a Plan. 

Have you seen the same problem before? Do you know a 
related problem? Consider auxiliary problems. 

Go back to definitions. 

3. Carry out Your Solution Plan. 

Check each step. Make sure each step is correct. 

4. Evaluate your solution. 

Can you check the result? Can you derive the result 
differently? Can you use the result or the method for some other 
problem? 

Figure 1: Polya's Problem Solving Methodology 



In the 1950's, computers made it possible to test out theories of 
problem solving. Allen Newell and Herbert Simon began to develop 
theories of human problem solving. Their view was that a good theory 
of problem solving should also be a good problem solver. They used 
computer simulation to test their theories. This work was very produc- 
tive. It led to advances in psychology, education and computer sci- 
ence. They worked on many problem solving programs including a logic 
theorist, a chess program and even a general problem solving program. 
This was nearly thirty years ago, and we are still working out the im- 
plications of this work. 



1.3 TEACHING GENERAL PROBLEM SOLVING 

There has been an increasing interest in incorporating courses in 
problem solving into curricula. General problem solving courses are 
taught to undergraduates in the Department of Psychology at Carnegie- 
Mellon University and in the College of Engineering at UCLA [Hayes, 
1981; Rubenstein, 1980]. These courses encourage students to see 
their skills in a general context and to learn how to learn. These 
courses have been in place for several years. The results have been 
good enough to continue them, however, there has been no formal vali- 
dation of these courses. 
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The interest in general problem solving can also be found in the 
educational psychology literature [Baird, 1983; Bourne, 1970; Feldhu- 
sen, et. al., 1972, 1975, 1979, 1980; Genya, 1983; Houtz et. al., 1973; 
Karat, 1982; Lukas, et. al., 1971; Pitt, 1983; Post and Brennan, 1976; 
Reif and Heller, 1982; Schwieger, 1974; Speedie, et. al., 1973; Thor- 
son, 1977 and Tuma and Reif, 1980], Most of these papers deal with 
experiments in teaching problem solving. There is little in the way of 
formal validation in the papers. This is not surprising since there is 
no generally accepted measure of problem solving ability although we 
were surprised to find that there are some attempts to measure this 
ability. One such test instrument is the Purdue Elementary Problem 
Solving Inventory [Purdue, 1973]. This test is aimed at elementary 
school students of different socioeconomic backgrounds. It is only par- 
tially relevant to this study. 

There are many questions about the teaching of problem solving. 
These would include: 

1. What is general problem solving? 

2. How is problem solving ability measured? 

3. Is the course effective in improving problem solving ability us- 

ing some measure? 

These questions are not answered by any of the literature we have 
found, although people are starting to pose them in one way or an- 
other. The teaching of problem solving skills would best be described 
as interesting but unvalidated. 



1.4 STRUCTURES OF PROBLEMS 

One major difficulty is that we do not see "general" problems. All 
problems we are presented with are domain specific. We spend most 
our school years from kindergarten through graduate school learning 
problem solving techniques for particular areas. It becomes difficult to 
see the forest for the trees. There are several ways that the struc- 
turing of problems can be approached. One way was the technique 
used early in the history of artificial intelligence. This was to assume 
that there were general techniques for solving problems and then try to 
design intelligent programs that incorporated these techniques and turn 
them loose on a variety of domains. The best example of this approach 
is the General Problem Solver (GPS) of Newell, Shaw and Simon [Ernst 
and Newell, 1969]. This was not really a unified computer program but 
instead was a loose alliance of concepts and programs that tried to 
achieve general problem solving ability in a variety of domains. 
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In more recent years, this approach has changed. Artificial intelli- 
gence has moved in the direction of knowledge based systems and ex- 
pert problem solvers which operate in limited domains (actually, GPS 
operated in limited domains as well, but its ambitions were much broad- 
er). There are many examples of expert or knowledge based systems. 
Two such systems are MYCIN which does infectious disease diagnosis 
and PROSPECTOR which aids in the discovery of mineral deposits [Barr 
and Feigenbaum, 1981]. The domain specific problem solvers do not 
represent a rejection of the earlier general problem solvers. They 
build on the earlier work using the same heuristics for analyzing prob- 
lems. They extend it by using more sophisticated methods for struc- 
turing knowledge and more special purpose heuristics. 

The most important thing is to develop a model of the problem solv- 
ing process and then try to decide what pieces of the model should be 
taught. One such model might be: 

1. Choose a problem. 

2. Choose a representation for the problem. 

3. Choose a solution method for your problem and representation. 

4. Evaluate the solution method at each point. 

5. Evaluate the result and recycle if necessary. 

Various approaches to problem solving will concentrate on one or an- 
other of these steps. Traditional courses typically focus on the last 

two points. The problem and the representation are already chosen for 
you. What matters is applying the solution method (e.g. the one in the 
book) and evaluating it (getting the "right" answer). This can be un- 
fortunate since it obstructs one's ability to generalize to different prob- 
lem domains. This would seem to be the case in the "real" world. There 
are numerous papers that document the lack of transfer effects in 
problem solving [e.g. Sweller, 1980]. 

There seems to be ample evidence that much can be gained by con- 
centrating on the first two points of this model, namely the issues of 
problem finding and representation. Often, a problem can be solved by 
recasting it in different terms. As an example, in the Middle Ages, it 
was believed that by diligent study, a university student should be 
able to master the art of long division, something that is normally 
taught in the third or fourth grade now. The problem was not that the 
medievals were any less intelligent than we are - they weren’t. They 
just had to cope with long division using Roman numerals. Changing 
the representation of the problem caused the problem to disappear. 
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One can find many similar examples. If you go into a mathematics 
library that dates back into the nineteenth century, you will find many 
large volumes of algebra books that deal with the theory of determi- 
nants. These books detail all the tricks for dealing with determinants 
that we learned in Algebra I many more besides. All that is gone to- 
day. The work is still as valid as it ever was. The advent of digital 
computers has simply made the use of tricks with determinants unneces- 
sary for solving large systems of equations. 

One approach that has been taken lately in the teaching of problem 
solving is to concentrate on developing problem finding and representa- 
tion skills. The theory seems to be that these skills are left undevel- 
oped by conventional teaching techniques or even that these skills are 
discouraged. This is the approach taken by Edward DeBono in his 
creativity courses. DeBono uses a variety of techniques to encourage 
subjects to try new approaches to problems. He tries to discourage 
what he calls "vertical thinking” by which he seems to, mean rigidly 
structured linear approaches to problem solving. He offers what he 
calls "lateral thinking" as an alternative. By this, he means the use of 
techniques which try to search out alternatives early in the problem 
solving process. His techniques rely heavily on brainstorming. In some 
ways, they seem to resemble Dada, the modern art movement of the 
1920’s espoused by Salvador Dali. One aim of Dada was to encourage a 
greater sensitivity to beauty by presenting images that were deliberate- 
ly shocking. In the same way, DeBono suggests posing "silly" solu- 
tions to problems to help break out of preconceived notions j of what is 
right. 

DeBono's work is widely touted to executives and seems to achieve a 
certain degree of success. Academics are less excited about it, no 
doubt partly because of DeBono’s style. He does not give credit to 
others for portions of his work which is derivative. The book is written 
in a generally pompous and authoritative tone. His approaches to 
problem finding and structuring are probably worth considering. They 
are far from a complete approach to problem solving. But, they do offer 
guidance in the initial stages of problem solving where people seem to 
need some encouragement. 

Another way to view problem solving is as a set of different domains 
that are best handled by specialists. If the problem solver is a manag- 
er, then his function should be to know enough about the different do- 
mains to be able to call in the proper expert. This was the approach 
taken in a paper written for the Naval Personnel Research and Develop- 
ment Center [Doherty, et. al., 1980]. This is similar to the approach 
taken by many MBA programs. The manager is viewed as a generalist 
whose function is to lead, to motivate, and to know when to call in the 
experts. The educational process makes the students familiar with the 
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different areas in a business so that they could call for specialists when 
necessary . 

The paper above had certain flaws. The authors seem to come from 
an organizational theory or organizational design background. Their 
taxonomy of problems and solutions was highly detailed in these areas. 
Other areas of management that are equally complex received one phrase 
dismissals (operations research or management information systems). 
Mark Twain's comment about everything looking like a nail to a man who 
only has a hammer seems appropriate here. But even if their taxono- 
my had been expanded, problems would remain. Problem taxonomies 
completely ignore issues of problem finding and choice of representa- 
tion . Before one can call in the experts, one must decide that some- 
thing is a problem. The problem must be represented in a certain way. 
By the time one calls in the experts, much of the important problem 
solving work has been done. 

If one had to lay out the skills for problem solvers, the choices 
would have to go beyond a simple taxonomy. Choices would include: 

1. Understanding skills. 

A good problem solver must be able to look at a situation in 
many different ways. Such a person must have a rich variety 
of representations for problems and know how to apply them in 
many different problem domains. 

2. Problem finding skills. 

It might seem that problem finding is unnecessary since prob- 
lems are usually thought of as forcing themselves on our atten- 
tion. Actually, one issue is what we should consider the prob- 
lem to be in a given situation. This relates to the previous 
point of choice of representation. 

3. Problem structuring skills. 

Once confronted with a problem, a problem solver must be able 
to structure the problem in such a way that it can be solved, 

4. Analytic skills. 

These are the heuristics and other methods for solving prob- 
lems that the cognitive psychologists and artificial intelligence 
researchers study . 

5. Knowledge base. 

To be able to solve problems, a person should have a base of 
knowledge in the problem domain under consideration. This 
knowledge should be structured so that it is accessible and can 
be used in the solution process. 
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The important point in understanding and teaching problem solving 
is to develop an overall model of the process, to teach problem solving 
as a process that can be decomposed into parts, to teach the process 
of decomposition, and to teach each of the parts of the process. This 
requires much understanding and practice from both students and 
teachers. It is not clear if it has ever really been tried. Most of us 
think that we are teaching "problem solving" whatever our specialty 
may be. In fact, most of us are experts in one domain or another, and 
we do not bring a great deal of true generality to the process. This is 
the challenge in teaching general problem solving. Whether it can be 
carried out successfully is an unproved proposition. 
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JOB REQUIREMENTS FOR NAVAL OFFICERS 



2.1 NAVAL ORGANIZATION 

The Navy is organized into operating forces and supporting shore ac- 
tivities. The operating forces are comprised of ships, aircraft, and Ma- 
rine combat units, which have combat and seagoing readiness require- 
ments whether they are based ashore or at sea [Price r 1973]. The 
primary function of shore activities is to supply, maintain and support 
the Navy's operating forces by obtaining material, services and person- 
nel.' The career Naval officer, who achieves the higher ranks, will com- 
mand both operating and shore activities. The next section describes 
the career pattern of a Naval officer. It is important to note that the 
Naval officer has dual responsibilities. The officer is trained an oper- 
ational job (e.g. fighter pilot or Weapons Officer) and at the same time 
must be a general manager, tending to the administrative needs of the 
operating forces. 



2.2 NAVAL OFFICER CAREER DEVELOPMENT 

The general career pattern for the Naval officer varies with the 
type of officer. Under the U. S. Code, Title 110, all officer classifica- 
tions and their billets correspond to a four digit designator code. Sev- 
en major officer categories can be identified 1 . They are: 

1. Undesignated Officers, designator 1100 

2. Surface Warfare Officers, designator 1110 

3. Submarine Warfare Officers, designator 1120 



Shepherd, Career Planning I nformation in Officer Professional Devel- 
opment, 1974, p.13. 
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4. 



Special Warfare Officers, designator 1130 

5. Aviation Warfare Officers, designator 1300 

6. Restricted Line and Special Duty Officers, designator - various 

7. Staff Corps Officers, designator - various 

Within each of the warfare categories (designator groupings) are job 
specializations, which are distinguished by the last two digits of the 
designator code (e.g. Pilot (1310), Flight Officer (1320)). Officers in a 
warfare specialty will further subspecialize into non-warfare areas. 
Each of the subspecialty areas receives an additional designator code 
listed under the Navy Officer Codes System. 

The Naval officer's career evolves through a progression of duty 
and training assignments. The career pattern is to some extent fixed 
once the newly commissioned officer commits to a particular specializa- 
tion within a designator. The career patterns of Unrestricted Line Offi- 
cers in surface, aviation and submarine communities are established by 
following the prescribed series of sea or squadron and shore billets ap- 
propriate for success within each community. The first duty is typical- 
ly operational. The junior line officer is assigned a sea or squadron 
tour which involves extensive training and experience in the warfare 
specialty. The goal here is to develop the officer's knowledge of the 
sea or squadron operations, equipment and warfare tactics. Emphasis 
is placed on performing those duties that lead to the largest gain in 
knowledge and on-the-job training in the specialty. Assignments to 
various duties are selected to build and reinforce the officer’s opera- 
tional experience in a particular warfare specialty. Duty assignments 
are also diversified with the expressed intent to cross train the officer 
to become proficient and knowledgeable across the spectrum of naval 
operations. A major goal of an officer is to obtain the command billets 
of Executive and finally Commanding Officer of a ship or squadron. 

The shore duty assignments generally remain operationally oriented 
but are more varied and open to be tailored to the officer's particular 
specialty interests. Shore tours are designed to enhance the value of 
the officer to the Navy and train the officer to function at higher levels 
within its organizational structure. The officer receives either additional 
formal training ashore or is assigned a special staff position. For the 
first shore tour of duty, the officer will choose a subspecialty which 
will determine, for the most part, future assignments ashore. Some of 
the possibilities for shore tours include postgraduate education, service 
college, staff duty, training instructor, or recruiting assignment. 
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As an officer's career progresses through the assignments of sea or 
squadron and shore tour, those achieving higher ranks eventually as- 
sume a major shore or staff command. The job of the Commanding Offi- 
cer is to manage Naval support and operational forces. Major com- 
mands involve the senior Naval officer in the management of activities 
not particularly related to their warfare specialty. 

A guidebook on Navy careers [Naval Military Personnel Command, 
1979] provides a general outline of for the several officer types. The 
typical career patterns for the Surface Warfare, Aviation, and the Nu- 
clear Surface Warfare Officers are illustrated in Figures 2, 3, 4, and 5 
of this report. The major steps of a line officer's career pattern were 
summarized in a Master’s thesis at the Naval Postgraduate School as fol- 
lows : 

a. Major shore command assignment on or about the 

22-year mark; , 

b. Generally, over 50% of time in service will be afloat or 

squadron units or in training for those units (for offi- 
cers in paths shown in Figures 2, 3, 4, and 5); 

c. The likelihood of Washington shore assignment for sen- 

ior officers (0-4 and above); and 

d. The predominance of subspecialty and staff duty for 

shore duty assignments 2 . 

For the Restricted and Staff Officers, the career patterns are much 
more specific to their designator. However, as with the Unrestricted 
Line communities, these officer also rotate through assignments relevant 
to their specialty and management support positions. 



2 



James V. Hodges and B. Rosakranse, Analysis of Training for Pro- 
spective Commanding Officers of Major Shore Activities , 1981, p. 38. 
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Figure 2: Surface Warfare Officer Professional Development Path 



AVIATION OFFICER PROFESSIONAL DEVELOPMENT PATH 



YCS 



CAPT 



24 



22 



CDR 



20 



18 



16 



14 

LCDR 12 
10 



8 



LT 



LTJG 



ENS 



CCHMMO 


SOIICK SMOtE 


CY/i m 




• MAJOR SXOR* STAff 


MAJOR 


• KCHIRffTCR 


d ut own 


SHOW 


• SUBPTOAJT 



• sonot njvtct caiat 



SHtf 

OtfT HUI 



cnim 



S3J«*a« 0) 



SDU1IICI ID 
•'■actcs iww I 

Will OEFT H0/SH1H/SM STAR 



'Huct -’wm 



a* wart 

. 'i sawn coma 
• ps unuancii 



• SHOTf STAR 



5HIP/IU STAff/SOUAMO* OOT HD 



riit mow 

• RJ6HT TPJUNI1M IW7WCTW 

• SHOW STAR • PS saioa. 



RUST SDOiDROI IOU* 



'■KMia 

RJGXT a Alii I! 
ira- i at 
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2.3 THE OFFICER AS GENERAL MANAGER 



The normal career path for a Naval officer includes assignment as a 
department head, executive and commanding officer, and ultimately a 
major shore command. Although an officer receives the extensive tech- 
nical training within a warfare specialization, only a relatively short 
period of time is spent functioning in this specialty. Officers rotate 
every two or three years between their military specialty and managerial 
support positions. As an officer’s career progresses, increasing amounts 
of time are devoted to management functions. 



2.4 MANAGEMENT TRAINING PROGRAMS 

To date, the only formal training a Naval officer receives to develop 
managerial skills is the Leadership and Management Education and 
Training (LMET) program, which is offered to officers of any rank, and 
two other courses for incumbent senior officers of major shore command 
billets, through the Naval Civilian Personnel Command [Hodges, 1981; 
Vandover, 1981 ] . 



2.4.1 Leadership and Management Education and Training 

The LMET training program was developed by McBer and Company 
based on McClelland’s theoretical concepts and research on leadership 
and achievement. The program was formally implemented in 1978 and 
currently has five levels of managerial training. The levels of training 
differ mainly in the content and the context corresponding to the type 
of managerial setting encountered under the position as commanding of- 
ficer or executive officer, department head, division officer, chief petty 
officer or petty officer. The instruction period is 10 working days. On 
the east coast, the LMET is offered in Memphis, Tennessee; Little 
Creek, Virginia; New London, Connecticut; Mayport, Florida; Pensaco- 
la, Florida; Newport, Rhode Island; Charleston, South Carolina. On 
the west coast, the LMET course is offered in Coronado, California; 
San Diego, California; Bangor, Washington; Treasure Island, California; 
and Pearl Harbor. Officers typically have the opportunity to receive 
the LMET training enroute to their new duty stations. 
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2.4.2 Training through the Naval Civilian Personnel Command 

The Naval Civilian Personnel Command offers two courses to senior 
Naval officers. They are the Senior Line Management Institute (5 day 
course), and the Prospective Commanding Officer Shore Station Manage- 
ment Training Program (three week course). The former course em- 
phasizes civilian personnel issues and the latter focuses on the manage- 
ment issues involving a typical shore command. 



2.5 PROBLEMS ENCOUNTERED DURING A NAVAL OFFICER'S CAREER 

Problems associated with officer management effectiveness have been 
observed [Rezin, 1976]. The managerial problems are perceived to be 
due to the lack of formal managerial training, short tours of duty, and 
short Naval careers [Shepherd, 1974, Rezin, 1976; Vandover, 1981]. 
However, the conventional principles of management as they apply to 
the private sector or governmental agencies do not strictly apply to 
the Naval officer performing administrative and management duties. 
The fact still remains that the Navy is a military organization and the 
nature of an "officer's job" is defined within its structure. That is, 
the officer is skilled within a warfare specialty or specialization and at 
the same time functions as a general manager. In the private sector 
and other governmental agencies people usually function in the single 
role of manager. In general. Naval officers are technically prepared to 
solve problems encountered in their specialties. Managerial skills, how- 
ever, must be learned informally from the administrative responsibilities 
associated with duty assignments. 
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A MODEL OF THE PROBLEM SOLVING PROCESS 



Before one can teach problem solving, one must have a definition of 
a problem. A good choice is: 

A person is confronted with a problem when he wants some- 
thing and does not know immediately what series of actions 
he can perform to get it. 3 

> 

The problem may be of any type, mathematical, social, managerial or 
whatever. The main feature is dissonance between the initial state and 
the ’ goal state. Presumably the problem solver has some means to 
translate the initial state to the goal state, although the transformations 
to be used may not always be obvious. 

Next, one must have a model of the problem solving process. There 
are many ways to do this. We will use the model shown in Figure 6 
based on that of Newell and Simon to represent the process. This is a 
general model of a solution process. It is similar to the design process 
in systems analysis and software engineering. This should be no sur- 
prise since these disciplines are simply formal, structured problem solv- 
ing methodologies. It should be recognized that this process is not a 
rigid, linear march toward a solution. At any point in the process, it 
is possible to backtrack and try another approach. Novice problem sol- 
vers frequently fail to realize this when they try to solve problems. 
Giving up too soon is one thing which distinguishes poor problem sol- 
vers from good ones. 



3 Newell and Simon, Human Problem Solving, p. 72. 
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1. Choose a representation for the problem. 

2. Choose a method for solving the problem from the collection of 

methods that work on the representation chosen. 

3. During the application of the method, several things can 

happen. They include: 

a) The problem is solved. 

b) The method is inadequate, and another method must be 
chosen . 

c) The representation is inadequate, and another representation 

must be chosen. 

d) The attempt to solve the problem is partially successful and a 
new subproblem is generated. 

e) The attempt to solve the problem is abandoned. 

4. During the solution attempt, subgoals are likely to be 

generated. These can be put aside for later work applying the 
same general problem solving format as before. 



Figure 6: A Model of the Problem Solving Process 



Any representation of a problem will be made up of several parts. 



They 


include: 




1 . 


A set of objects. 




2. 


A set of operators that transform objects in 
into other objects. 


the problem space 


3. 


An initial state. 




4. 


A goal state. 




In school problems, we are given all parts of the 


representation . We 



have the objects, operators, initial state and goal state. The learning 
objective is acquire a strategy for applying the operators. Even there, 
we are usually limited. Intentionally or not, most students learn that 
the way to solve the problem is to reproduce the "correct” solution 
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methods in the book. It is small wonder that most people are not 
terribly creative at problem solving. 

The choice of a representation can mean several things. First, it is 
the choice of problem. Our definition at the beginning of the section 
defined a problem as dissonance between the current state and the de- 
sired state. Finding a solution means reducing this dissonance. But, 

there may be more than one way to reduce this dissonance. The 
problem solver will not necessarily find the correct ways to reduce it. 
This is the problem finding process, and it is part of the process of 
choosing a good representation. 

For example, suppose that a company is losing money. There may 
be many reasons for this. It could be: 

1. A production problem. 

Production costs are too high; new equipment is needed. 

Inventory costs are too high; production schedules are bad. 

Shipping costs are too high; a new routing scheme is needed. 

2. A marketing problem. 

Producing the wrong product for the market. 

Targeting the wrong market. 

Pricing the product incorrectly. 

3. A financial problem. 

The company has cash flow problems. 

The capital structure needs revised. 

4. A personnel problem. 

The company needs to be reorganized. Key workers are un- 
derpaid. 

Once we have decided what the problem is, we have to choose a 
representation to express it. If the problem is a production problem 
where a new routing and warehouse structure is needed, perhaps a lin- 
ear program would be a good representation. Maybe an integer vehicle 
routing algorithm would be more appropriate. The richer a repertoire 
of representations we have, the better we will do with the problem. 

The choice of representation is a difficult problem. A good repre- 
sentation limits search without adding unnecessary constraints. It al- 
lows us to look at a problem in depth, discarding search paths that will 
be unproductive. Some of the specific problems with representations 
will be discussed in the next chapter. 
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3.1 PROBLEM SOLVING AS A PROCESS 



The choice of a problem and a representation for t lie problem con- 
verts an ill-defined problem to a well-defined problem. With a repre- 
sentation in hand we can begin applying search strategies that trans- 
form an initial state into intermediate states and finally to our goal. If 
we are lucky, we may have an optimization problem. For optimization, 
we know that a solution exists that is better than or equal to all other 
possible solutions. If we are even luckier, we may have an algorithm 
that can discover this solution with a reasonable amount of effort. 

More likely, however is the case where optimization is not possible. 
It may be possible, but we do not know how to do it or cannot do with 
reasonable effort. This is the case with many problems that generate 
computationally intractable integer programs (e.g. assembly line balanc- 
ing problems). Then, we have to fall back on heuristics - that is rules 
of thumb. A heuristic generates good solutions with >a reasonable 
amount of effort. It does not guarantee optimality. Consider chess as 
an example. It is possible to have a computer start with an initial 
chess position and generate end games. Then, all we have to do is 
pick the sequence of moves that guarantees us the best final position 
no matter what our opponent may do. This is the essential idea behind 
game theory and is called a "minimax" strategy. 

This is not much help for solving real chess problems. It has been 
estimated that there are 10 120 different endings to the game tree for 
chess. This is a big number, and we need to give it a little perspec- 
tive. It has also been estimated that there are 10 79 elementary parti- 
cles in the universe. This means that there are 41 orders of magnitude 
more endgame situations in chess than there are elementary particles in 
the universe. Suppose then that every elementary particle in the uni- 
verse were a computer grinding out chess solutions at the rate of one 
per nanosecond (much faster than any conceivable computer could do 
it). Then, it would take 10 41 nanoseconds or about 3.2 x 10 24 years 
to compute all chess endgames. Since the universe is about 2 x 10 10 
years old, this is roughly 160 trillion times the age of the universe. 
Computational problems of this magnitude are remote even if we could 
convince every elementary particle to be a computer. 

Obviously, a strategy to limit search effort is needed. This is 
where heuristics come in. A heuristic is a rule to limit search in prob- 
lem solving. In chess, there are many such rules. One example might 
be to protect your queen. This is the most powerful piece on the 
board, and you are in trouble if you lose it. On the other hand, 

blindly following this rule can cause one to overlook queen sacrifice 
strategies that could lead to a win. 
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There are many heuristics in general problem solving. Examples of 
search strategies include: 

1. Trial and error - try all possible options without selection 

rules . 

2. Depth first - search deeply along one search path. 

3. Breadth first - search all the moves at one level before moving 

to the next level. 

4. Segmentation - break a problem up into subproblems. 

5. Hill climbing - make small moves in directions around your pres- 

ent position. Then move in the direction that yields the great- 
est improvement and start over. 

6. Working backwards - assume you are at the solution and then 

reconstruct the moves you would have to have made to get 

there. 

7. Analogy - compare this problem to an existing problem for which 

you already have a solution. 

These problem solving methods can be regarded as a bag of tricks. 
No one problem solving method uses just a single heuristic. A good 
general problem solver would apply one or another where appropriate. 
As an example, consider chess again. The best approach might be to 
start with a breadth first search to identify likely candidate paths. A 
breadth first search is limited because of the many possibilities. After 
suitable candidates have been identified, the depth first techniques can 
be used. Analogy could be used to compare the current game situation 
with past games. Besides these general heuristics, special purpose 
heuristics could also be used. 

The ideas behind general purpose heuristics are not difficult to un- 
derstand. But, people seem to have trouble in applying the ideas. 
Research shows little transfer from the general techniques to specific 
problem domains. There may be many reasons for this. One may be 
insufficient practice in applying general as opposed to domain specific 
techniques . 
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PROBLEM DOMAINS AND THE ROLE OF MODELS 



There are many problems when one tries to address problem solv- 
ing in general. Problems present themselves in specific formats. Per- 
haps our education is responsible. Problems are always presented in 
the context of a course studying specific methods of solution. The fo- 
cus is to learn the methods and get the answer in the book. Problem 
solving becomes a matter of acquiring specific techniques and replaying 
the appropriate script when the right problem comes along. 

This type of education may be necessary for people to learn gener- 
ally accepted methods of solving problems. But, it does not offer much 
guidance about what to do when faced with new kinds of problems. It 
is possible to go through formal education all the way to the doctoral 
level without ever considering how one actually solves problems. The 
process of solving problems has to be learned by example. The knowl- 
edge and methods picked up in courses forms a paradigm for a new 
generation of problem solvers to follow. There is seldom any attempt to 
generalize the methods learned in one area and transfer them to other 
areas . 

A good example of this is calculus. Most of us remember the stan- 
dard Freshman calculus sequence. The examples presented in the book 
exhibited a linear progression from initial assumptions to final solution. 
It was intimidating to find that one's own work toward a solution was 
seldom so clean or logical. It usually contained many false starts, 
backtracking and missed assumptions. If we were good at calculus, we 
could eventually approximate the solution methods in the book. If we 
were not, calculus rapidly became a traumatic experience. We felt that 
real mathematicians were those who could write the type of problem 
solving sequences illustrated in the text. 

This is not necessarily true. If one were to go back to Newton's 
original work on the calculus, one would find that it was as full of false 
starts and strange assumptions as any other beginner's work. It is 
unlikely that even a professional mathematician today could read it and 
understand it. It was couched in terms acceptable to a limited number 
of seventeenth century mathematicians who were proficient in geometry. 
It is almost unreadable today. It was almost another century before the 
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Bernoulli brothers were able to put it into a form that could be widely 
applied . 

This is especially noticeable in mathematics, but the same comments 
could be applied to any other branch of knowledge. Teaching was and 
is largely concerned with examples of solution techniques and transmis- 
sion of knowledge. Very little of it focuses on the specific methods (if 
any) by which solutions are reached and new knowledge may be added. 



4.1 EXAMPLES OF PROBLEMS 



To illustrate some points about the structure of problems represen- 
tations and problem domains let us consider some different problems. 
These are presented in no particular order. 



1 . 



Fill in the digits represented by the letters in the sum given 
below: 

SEND 
+ MORE 



MONEY 

This is the type of crypta rithmetic problem that delights puzzle 
fans. Solving this one requires changing representation (sub- 
stituting digits for the letters) using a trial and error process 
aided by a few heuristics (example - the letter M must repre- 
sent 1). This example involves much backtracking and testing 
of assumptions. 

2. Suppose that you were to meet a friend in New York City. You 
knew the date on which you were to meet but that was all. 
Your friend knew the same. You cannot communicate with each 
other to settle on a time and place. Choose a time and a place 
to meet your friend. 

It is obvious that this problem cannot have a "right" answer in 
the sense that a math problem can. But for large numbers of 
people (mostly those familiar with New York City), the problem 
may be solvable. The trick is to assume that the other person 
will choose an obvious place and time and then try to do the 
same yourself. It is an example of the way specialized knowl- 
edge is used in problem solving. The most common choice for 
New Yorkers is under the clock at Grand Central Station at 
noon. Non-natives do not do nearly so well on this one. 
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3. Give the next digit in the sequences: 



1 , 2 , 3 , 4 , 5 , ... 

1,4,9,16,25, ... 

1,2,3,5,7,11, ... 

14,18,23,28,34,42, . . . 

This problem is like many other problems in mathematics. The 
idea is to find the underlying pattern and then use induction 
to work things out. The trick is to recognize patterns, and 
test hypotheses about how those patterns are formed. The 
first sequence is simple counting, the second is the squares of 
the integers, and the third is the sequence of primes. All 
these nice logical sequences leave the problem solver unpre- 
pared for the fourth sequence. The next number in the se- 
quence is 50, but the subject would be unlikely to get this 
without specialized knowledge. This is a sequence of subway 
stops on the I RT in Manhattan. 

4. Solve the following for X: 

X = 2*SQRT(2*SQRT(2*SQRT ( ... ))) 

This problem is an example of how representation can help. 
This problem looks almost impossible expressed in functional 
notation or in radical notation. If it is translated to exponen- 
tial notation, it becomes trivial. 

5. Suppose you had six toothpicks. Construct four equilateral tri- 

angles each of whose sides is one toothpick long out of the six 
toothpicks . 

This problem offers an example of ways in which subjects can 
block themselves by adding constraints that are not there. To 
solve it, just construct a tetrahedron. That only requires six 
toothpicks and each face is an equilateral triangle. The prob- 
lem for most people is that they add the unstated constraint 
that the figure must be two dimensional. 

6. You have been challenged to a game of Number Scrabble. You 

and your opponent have nine tokens in a pile between you. 
The tokens are numbered 1 through 9. You take turns draw- 
ing tokens from the pile. The first person to have three to- 
kens (drawn in any order) whose sum is 15 wins. Devise a 
strategy for this game. 
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The interesting thing about number scrabble is that you have 
already devised a strategy for playing it. Suppose you ar- 
ranged the numbers like this: 



6 


1 


8 


7 


5 


3 


2 


9 


4 



This figure is called a "Magic Square". The magpie is that the 
numbers in the rows, columns and diagonals all sum to 15. 
This is exactly the requirement for a win in Number Scrabble. 
With this change in representation , Number Scrabble should 
look familiar. It is an isomorph for Tic-Tac-Toe and the same 
strategies that work for one will work for the other. 

7. Suppose you were General Eisenhower trying to decide how to 
choose a date for D-Day. How would you go about solving this 
problem? ( 

This is the classical unstructured, large, messy management 
problem. There is no particular method that will work. It is 
more a problem of defining the goal, breaking that definition 
down into subgoals, looking at constraints, modifying goals and 
so on. The paradigm developed by Newell and Simon works 

here too. It is just much more involved. The major problem 
(for General Eisenhower at least) was to structure the problem 
select the goals (by no means as clear then as now). He could 
let his staff work out the details while he monitored the prog- 
ress . 

One could go on with example problems forever. Sometimes this 

seems to be the approach of books on problem solving. The problems 
above are from a variety of areas. They are not necessarily "fair" in 
the sense that they follow well defined rules. They are not necessarily 
well structured. They do illustrate some good points about the problem 

solving process that reinforce the choice of a problem solving model 

made in Chapter 4. 
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First, there is the importance of choice of representation. This is 
shown in the square root problem, the six triangles problem, and the 
Number Scrabble problem. The wrong choice of representation can 
render even simple problems unsolvable. The right choice of represen- 
tation can make a problem disappear. Deciding on what is the right or 
wrong representation is no easy matter. It seems clear that some rep- 
resentations dominate others (e.g. Arabic numerals as compared to Ro- 
man numerals). It is not clear how to set up criteria for comparing 
representations. One characteristic of gifted problem solvers is their 
ability to change representations. One example was Albert Einstein who 
used many unusual problem representations in deriving and explaining 
his theories. 

A second point illustrated is the importance of knowledge in many 
problem solving situations. The problem about where to meet in New 
York, the last "complete the sequence" problem and Eisenhower's prob- 
lem on D-Day all involve specialized knowledge. It would £>e convenient 
for education if specialized knowledge of real problem domains were not 
necessary, but this seems increasingly unlikely. 

A final point illustrated by the last problem is the importance of 
problem finding. It was not obvious that the European invasion should 
take place in Normandy in the Spring of 1944. The Americans initially 
pushed for 1943. The Russians were pushing for a second front as 
early as possible. Churchill at times wanted to go for the "soft under- 
belly" of Europe by invading through Southern France or Sicily (per- 
haps he wanted to redeem the disaster at Gallipoli thirty years earlier). 
The initial problem here was to define the problem. 

It seems that education concentrates mostly on the importance of 
knowledge. Choosing new representations or using problem finding 
skills is actively discouraged. If people are allowed to play with the 
representation of a problem, they might not learn the methods in the 
book. In general, this may not be bad. But it can discourage cre- 

ativity in the gifted minority. The same is true of problem finding. 
All through the educational process, problems are given. Little attempt 
is made to break out and encourage students to find and define their 
own problem. If we are interested in teaching problem solving, these 
are issues that must be faced. By the graduate level, it may be too 
late to do this. 
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4.2 CLASSIFYING PROBLEM DOMAINS 



Classifying problems into categories offers many possibilities for 
trouble. Any classification scheme is likely to be limited by the bias of 
the individual setting up the scheme. The present authors are no ex- 
ception to this. 

As a starter, we would propose classifying problems as either well 
defined or ill defined. A well defined problem can be defined as: 

A problem proposed to an information processing system is 
f, well defined" if a test exists, performable by the system 
that will determine whether an object proposed as a solution 
is in fact a solution. 4 

This definition of a well defined problem fits most of the mathematical 
and logic problems commonly found in books. Many managerial prob- 
lems, on the other hand would have to be classified as ill defined. The 
"information processing system" referred to in the quote is completely 
general. It could be either a man or a machine. For a problem to be 
well defined, we must have done the initial work of problem finding and 
selection of a representation . If not, no test can exist because we do 
not know what we are testing. 

If no representation of the problem exists, then we have an ill de- 
fined problem. Our first task is to decide what the problem is. Then 
we can create a representation for it. This situation characterizes 
many of the management problems that a Naval officer (or any other 
manager) will face. In one sense, all problems could be considered well 
defined. If a problem is dissonance between the current state and a 
goal state, then any action that causes the dissonance to disappear is a 
solution . 

As an example, consider a manager whose company is not profitable. 
He could view this problem in a variety of ways. Perhaps it is a mar- 
keting problem. The company has targeted the wrong market or is us- 
ing the wrong advertising strategy. Maybe he could view it as a pro- 
duction problem. Production costs are out of control and need to be 
brought back in line. Perhaps it is a personnel problem. Poor em- 
ployee morale is hurting productivity. Or perhaps it is not a problem 
at all. Maybe the manager views it as a startup phenomenon that will 
go away as the product line matures. The choice of representation and 
definition of the problem will determine what is done about it. 
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Allen Newell and Herbert Simon, Human Problem Solving, p. 73. 



Once a problem has been defined and a representation chosen for it, 
then it becomes a well defined problem. Then, we have a series of 
steps (operators) that we can use for solving the problem, and a cri- 
terion for stopping our search. Most disciplines concentrate on this 
part of the problem solving process. This is not surprising. They are 
trying to teach problem solving within the framework of a discipline. 

One way to represent problems would be as a task environment. In 
this approach, we partially follow Newell and Simon 5 . A task environ- 
ment can be looked at in a variety of ways. They are: 

1. A set representation of a problem. 

Given a set U, find a member of set U having specified prop- 
erties (our goal) . 

2. A search representation of a problem. , 

Given an initial state, a set of transformations and a goal 
state, move from the initial state to the goal state. 

3. A design representation of a problem. 

Given a problem situation, define the problem and create a 
representation for it. 

An example of the set problem might be to find the combination of a 
safe. The set of possible solutions is known but large and the problem 
is to search that space. An example of the second type of problem is 
the proof of a mathematical theorem. We begin with a set of initial con- 
ditions, we have a series of transformations, and we wish to arrive at 
our goal (the theorem) by applying these transformations. The imple- 
mentation of the decision to invade Europe during World War II is an 
example of the last type of problem. So would the decision to set up a 
mass transit system for a city or region. 

These three definitions of a task environment are not mutually ex- 
clusive. All three of them could be used in resolving a problem situ- 
ation as might be the case in an engineering design problem. Most of 
our schooling revolves around the first two task environments. The 
real world is the last type. 
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Allen Newell and Herbert Simon, Human Problem Solving , pp. 73-77 . 



4.3 MODELS AS REPRESENTATIONS OF DOMAINS 



When we find ourselves faced with a problem situation, we have to 
have some way of understanding it. For this, we typically use models 
of some kind. In this context, a model is a mental structure that can 
be used to test hypotheses and behavior of a real world system. A 
map would be an example of a model. It is an abstracted representation 
of real world features we are interested in. Maps will differ greatly in 
the features they show depending on the use we wish to make of the 
map. For instance, if we are hiking, our best choice is a contour map 
of the area. If we are flying a plane on instruments, we need a map 
showing names and frequencies of navigational aids and minimum safe 
altitudes on route. Terrain features are irrelevant in this kind of mod- 
el . 



A full discussion of modeling in problem solving would be philosoph- 
ically involved, lengthy and beyond the scope of this report. Modeling 
is more of an art than a science. It is nothing more than the choice of 
representations for task environments. A good model should: 

1. Display the state of the system before and after transforma- 

tions. 

2. Be capable of being manipulated. 

3. Be capable of predicting system behavior. 

4. Provide an adequate representation of all features of interest in 

the system. 

An example of a model would be the use of Euclidean Geometry to rep- 
resent limited portions of the surface of the earth. This fits points 1 
through 3 for a good model. If we are only interested in limited sur- 
faces, then it fits point 4 as well. Newtonian mechanics in physics is 
another model example. It fits points 1 and 2. For phenomena where 
relative velocities are low, it also does well on points 3 and 4. But, if 
we are talking about high relative velocities, it breaks down completely. 



4.3.1 The Role of Assumptions in Modeling 

Assumptions are constraints that allow us to bound a problem. The 
assumptions we make limit the solution search process. Reitman [1965] 
suggested that the process of problem solving is frequently the process 
of successively adding constraints to the problem state. Each con- 
straint cuts away pieces of the solution set and reduces search. 
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Constraints may be externally imposed. All vve need to do is have 
the wit to recognize them. Eisenhower’s D-Day decision had many ex- 
ternally imposed constraints. The invasion had to take place in 1944 
for political reasons. It had to be in the Spring to allow the Allies to 
take maximum advantage of good weather. There were only a few days 
in the Spring that allowed the right combination of tides for a landing. 
All these constraints helped bound the problem and reduce an unstruc- 
tured design problem to a structured problem. 

We have to be careful not to introduce unnecessary constraints in a 
problem. This is the case in the problem of the six toothpicks posed 
earlier. Subjects add a constraint that the solution be confined to two 
dimensions that makes the problem impossible to solve. This type of 
thinking gets in the way of innovative problem solving, but it is prob- 
ably necessary. The addition of constraints makes the search process 
manageable and speeds up problem solving. At some point, it may be 
necessary to back up and remove constraints. This usually proves to 
be hard to do. The problem solvers we refer to as ’’geniuses” are usu- 
ally the people who have this ability. 



4.3.2 Limitations of Models 

We must keep the limitations of models in mind. A model is not the 
real world. It is only an abstraction of that world. A model must be 
validated against an external reality. When we do this with most mod- 
els, we find that it has a limited domain of applicability. There is 
nothing wrong with this. But, it does mean that we should sometimes go 
back and examine the constraints we have accepted by using the model. 

It is important to realize that the choice of models is a choice. It is 
not something that must be accepted without question. Our representa- 
tion of a problem offers both advantages and disadvantages. Students 
must realize this. Often, they have invested so much effort in learning 
a model that they are reluctant to abandon it. A problem solving 
course would have tc develop techniques to encourage students to move 
freely between different models of problems and to be creative in mak- 
ing up their own representations. This is one of the things that DeBo- 
no tries to do in his approaches to problem solving, and it is probably 
worth doing. The inability to see representations as arbitrary is prob- 
ably one factor inhibiting transfer of learning in problem solving. 
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LEARNING TO APPLY GENERAL PROBLEM SOLVING 

TECHNIQUES 



The study of problem solving has not made a large impact on educa- 
tion yet. This is not surprising. Education is a conservative field and 
is not quick to embrace fundamental changes even when they are of 
proven benefit. The so called New Math involved mathematical ideas 
that were about a century old when they were introduced. General 
problem solving is on nowhere near as sound a footing as the material 
in the New Math. 



5.1 SURVEY OF TEACHING GENERAL PROBLEM SOLVING 

There are few courses in general problem solving taught at the uni- 
versity level. We found documentation on two and have heard of oth- 
ers. The first course on which we have information is taught by John 
R. Hayes of the Department of Psychology at Carnegie-Mellon University 
and the other is taught by M. F. Rubenstein of the School of Engi- 
neering at UCLA. The course descriptions are given in Figure 7. 

We have no firsthand knowledge of these courses, although we 
spoke to Hayes about the course at Carnegie. The course has been 
taught for several years now and has settled down. It is offered to 
entering students early in their career. Hayes has written a book 6 to 
support the course. The book is best described as an applied cognitive 
psychology text. It is divided into four sections. An outline of the 
topics is given in Figure 8. The first section deals with general search 
strategies. It tries to get the reader to see the general features of a 
problem instead of trying to reproduce a book solution. The second 
section deals with the classical cognitive psychology view of memory 
structure. It also offers strategies for structuring knowledge (mne- 
monics, time lines, etc.) that allow a student to acquire knowledge 
without trying to resort to simple cramming. The third section deals 



6 John R. Hayes, The Complete Problem Solver, Franklin Institute 
Press, 1981. 
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Carnegie-Mellon University Department of Psychology 

Psychology 85-113 - Psychology of Learning and Problem Solving 

A course aimed at increasing students’ learning and problem 
solving skills through understanding and applying topics in 
cognitive psychology. Topics covered will include representing 
problems, searching for solutions, making decisions, learning, 
use of technical reasoning. Considerable emphasis will be 
placed on learning and problem solving in the physical sciences. 



UCLA School of Engineering 

Engineering 11 - Patterns of Problem Solving 

An introduction to patterns of reasoning in the process of 
problem solution and decision making. Exposure to concepts, 
theories and techniques in the analysis and synthesis of total 
systems in our complex technological civilization. 



Figure 7: Course Descriptions in Problem Solving 



with decision making. It discusses the structuring of decision problems 
and their impact on decisions. It also presents some statistical decision 
theory and cost-benefit analysis as examples of decision structuring 

tools. The last section is on creativity. It analyzes the sources of 

creativity and conditions affecting creativity. The book is written at a 
level that is appropriate for undergraduates . 

During our visit to San Diego, we discussed the course with Hayes. 
He felt that it was working well after many years of experimentation 

and change. He also felt that the course was finally to the point where 

it was exportable to other institutions. Several different instructors 
had taught the course at Carnegie with reasonable success. There has 
been no formal validation of the course. Hayes said that he receives a 
gratifying amount of positive feedback from former students. He would 
like to perform a formal evaluation of his course, but has not had the 
time or resources to do so. 

One important point that Hayes emphasized about this course was 
the need for practice in the problem solving techniques presented. 
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1. Problem Solving Theory and Practice 

a) Understanding Problems: The Process of Representation. 

b) Search 

c) Protocol Analysis 

2. Memory and Knowledge Acquisition 

a) The Structure of Human Memory 

b) Using Memory Effectively 

c) Learning Strategies 

3. Decision Making , 

a) Getting the Facts Straight: Making Decisions in a Complex 

World . 

b) The Luck of the Draw: Dealing with Chance in Decision Making 

c) Cost-Benefit Analysis 

4. Creativity and Invention 

a) Cognitive Processes in Creative Acts 

b) How Social Conditions Affect Creativity 

Figure 8: Outline - The Complete Problem Solver 



Without adequate practice, the whole thing is a meaningless exercise. 
This means that it would be necessary to choose a set of problems de- 
signed to emphasize the points presented in the course. The problems 
should probably be from domains of interest to the student. This 
means that "silly" problems (Tower of Hanoi, Missionaries and Canni- 
bals, etc.) should probably be kept to a minimum. Some of these 
problems could be used to introduce the general nature of the problem 
solving process, but after that, examples that are relevant to the stu- 
dents' interests would be best. 
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Another factor that we feel is important is the teacher. The in- 
structor of this course should be a first rate teacher with a good grasp 
of the principles and goals of the course. Hayes is an outstanding 
teacher (based on the author's personal experience). He knows the 
subject, he has a relaxed and supportive style, and he is able to draw 
on wide experience for relevant examples. These are essential points 
when one is trying to present material that is out of the ordinary. 
Some effort has to be made to sell the students on the usefulness of the 
course. 



5.2 OTHER EDUCATIONAL RESEARCH IN GENERAL PROBLEM 
SOLVING 

There is a small literature in educational research in the study of 
general problem solving. It does not seem to be an area that has at- 
tracted widespread interest when compared with the literature on more 
conventional subjects like mathematics or reading). One article by Post 
and Brennan [1976] dealt with an experiment in teaching geometry to 
two groups of tenth grade students. 

The authors developed a test of problem solving ability and adminis- 
tered it as both a pretest and a posttest to two groups of tenth grad- 
ers. One group had received instruction in the General Heuristic 
Problem Solving Procedure (presented in Figure 9) while the other did 
not. The reader should compare the model in Figure 9 with that of 
Polya's in Figure 1. The two are similar, although Post and Brennan 
do not cite Polya. The two groups did not show any significant differ- 
ence in problem solving ability. The authors offer a detailed discussion 
of the statistical methodology they used. This discussion would be ap- 
propriate for a beginning experimental methods course. Unfortunately, 
they tell us nothing about how the problem solving methodology was 
taught. Were students merely exposed to it? Did they get substantial 
practice with it? These are questions left unanswered. The conclu- 
sions in the article are too strong to be justified by the material pre- 
sented . 

Raaheim and Kaufmann [1974] tested 73 secondary school students 
using tests of the subjects' ability to manipulate their environment. In 
one test, the subjects were asked to tell how to save a kitten stranded 
at the top of a tree. The lowest branch on the tree was too high to 
reach. The tools that they had available were a strong drill, a hammer, 
a pair of pliers and a plane. The "best" solution involved drilling 
holes in the tree trunk and then using the hammer, pliers and even the 
drill as "steps" to climb the tree. There were other tests in a similar 
vein. They seemed to test the subjects' ability to overcome functional 
fixity in solving problems. 
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I. Recognition, Clarification and Understanding of the Problem. 

1. Read the problem carefully. 

2. Look up any words you do not understand, 

3. What is the unknown? What are the data? What is the 

condition? What is given? 

4. State the problem in your own words. 

5. Break the problem into parts. 

6. Draw a diagram to aid in clarification. 

7. Accept or reject the specific problem tools as a problem 

for yourself. 

II. Plan of Attack - Analysis 

1. Gather data (facts, rules, relationships) which are 

necessary for solution. 

2. Recall missing data, select relevant data from the 

problem statement, and generate new data if necessary. 

3. Eliminate irrelevant data. , 

4. Decide on needed approach activities by noting obstacles 

to the solution of the problem. 

III. Productive Phase 

1. Find the connection between the data and the unknown. 

You may have to consider auxiliary problems if an 
immediate connection cannot be found. Do you know a 
related problem? 

2. Generate a hypothesis or a number of alternative 

hypotheses (possible solutions of the problem). 

3. Order your data in preparation for hypothesis testing. 

4. Reject initial hypotheses that do not satisfy the 

conditions of the problem. 

5. Select a remaining hypothesis for testing. 

6. Construct an algorithm or develop a heuristic for the 

manipulation of data as an instrument for possible 
verification of a hypothesis. 

IV. Validating Phase - Checking - Proving 

1. Accept or reject the hypothesis by verifying or not 

verifying that it meets the conditions of the task. 

2. Look back. Can you check the result? Can you check the 

argument? Can you derive the result differently? Can 
you use the result or the method for some other problem? 

3. If you have rejected your hypothesis, select a remaining 

one for testing. 



Figure 9: General Heuristic Problem Solving Procedure - Post 
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Success on their tests correlated highly with IQ. Girls were signif- 
icantly poorer problem solvers than boys. The authors attributed this 
to their unfamiliarity with the tools posed in the problems. A possible 
alternate explanation might be that girls are more strongly socialized to 
be "good" . This would tend to cause them to ignore the rule breaking 
required in these problems. The authors conclude that general problem 
solving ability exists and is highly correlated with conventional meas- 
ures of intelligence. 

The paper by Reif and Heller [1982] is a prescriptive piece. They 
lay out a teaching methodology for physics based on the general prob- 
lem findings in cognitive psychology. They outline a strategy for 
structuring knowledge and acquiring knowledge in physics. They 
present a detailed program for physics instruction. There is no empir- 
ical validation, but they do try to tie the points stated in their recom- 
mendations into previous empirical work. 

A series of papers by Feldhusen et. al. [1972, 1975, 1979, and 
1980], Houtz et. al. [1973] and Speedie et. al. [1973] covers research 
done in general problem solving in education at Purdue University. 
The work developed a measure of problem solving ability appropriate for 
elementary school children from different socioeconomic and cultural 
backgrounds. Because of the age of the students involved, this work 
is not relevant to this report. One interesting thing about this series 
of papers. They point up the isolation of the education literature from 
other research in problem solving. It is not until the 1979 paper in the 
series that any work by Simon is mentioned. Most of the references 
are to educational journals. The papers themselves are heavy with ed- 
ucational jargon that helps hide their lack of useful content. 

A paper by Thorsen [1977] discusses the use of simulation to teach 
problem solving approaches at Denison University. The paper itself is 
a short survey of the problem solving literature followed by arguments 
justifying the use of simulation for the teaching of problem solving. 
The article has little to say about the teaching of problem solving. It 
does not even tell us whether the experiment was successful or what 
might constitute success or failure. 

A paper by Baird [1983] offers an interesting summary of the prob- 
lem solving research in education. Baird’s report is similar to ours in 
that he is surveying the literature to see what has been done in prob- 
lem solving and what benefits may result from teaching problem solving. 
He concludes that the benefits from teaching generic problem solving 
are difficult to prove. He believes that general problem solving tech- 
niques are probably most effective when they are integrated into domain 
specific courses. 
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A last paper is that by Ruth Pitt [1983], It is a comprehensive 
literature survey of the psychological literature on the development of 
general problem solving schema. The work concludes that the develop- 
ment of a GPS schema takes place between adolescence and early adult- 
hood. She studied two groups of students, one group of tenth graders 
and one group of college students. She found that the tenth graders 
had limited ability to define problems and generate hypotheses. They 
did not seem to have a rich set of problem representations or methods 
for dealing with problems. The college students were much better. 
Their abilities approached that of professors on most measures. The 
findings here are preliminary, but there are some interesting implica- 
tions. Pitt suggests that the time to teach general problem solving 
techniques is in early adolescence when such concepts are being 
formed. More mature students are likely to respond better to domain 
specific techniques. For better or worse, their skills may already be 
formed . 

i 

If these papers are indicative of the general level of interest in ed- 
ucation in teaching general problem solving, then the level of interest 
cannot be very high. It would seem that the primary influence of the 
general problem solving work has been to stimulate new approaches to 
the teaching of conventional disciplines as in the Reif and Heller arti- 
cle. There is little work involving the teaching or study of general 
problem solving ability. It may be that the concept is too hard to de- 
fine and that it is safer to stay with conventional disciplines. It may 
also be that the best approach to general problem solving techniques is 
to integrate them in conventional areas to improve retention and com- 
prehension . 



5.3 EXPLORATION - A STUDY OF PROBLEM SOLVING 

An interesting literature studying problem solving is growing in the 
intersection between computer science, human factors and psychology. 
This is the study of exploration and exploratory environments. This 
literature is represented in the papers by Anzai and Simon [1979], 
Carroll, et. al. [1982, 1982a, 1983, 1983a, 1984, and 1984a], Darling- 
ton, et. al. [1983], Lewis, et. al. [1982], Malone [1981, 1981a, 1981b, 
1981c, and 1982), Schrager and Klahr [1983] and Winston [1980]. This 
literature looks at the way people learn about an environment without 
formal instruction. They must take their clues from the environment, 
form hypotheses and act on the basis of these hypotheses. 

This study is of interest to cognitive psychologists because it pro- 
vides a way to study human problem solving behavior in a controllable 
environment. It is of potentially greater payoff to the computer indus- 
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try. The quality of the man-machine interface can be crucial to the 
success of a piece of software. In microcomputing, some programs are 
popular partly because of their ease of use (LOTUS 1-2-3 is a good ex- 
ample). Other programs that may be equally powerful but unappealing 
to use become commercial failures. 

Carroll [1982a] compares learning to use a word processor with the 
fantasy game "Adventure”. Both are computer programs. The Adven- 
ture program is intentionally confusing, but it draws users into the 
world it creates. In Carroll's comparison, many word processors offer 
the same kind of confusion as Adventure without offering a balancing 
incentive to push past the confusion and learn the system. Carroll's 
classification of problems faced by these computer users is given in 
Figure 10. 



Disorientation The user/player doesn't know what to do in the 

system environment. 

Illusiveness What the user/player wants to do is deflected 

toward other, perhaps undesired, goals. 

Emptiness The screen is effectively vacant of hints as 

to what to do or what went wrong. 

Mystery Messages The system provides feedback that is useless 

and/or misleading. 

Doing the "same thing” in different 

situations has unexpectedly different 
consequences . 

Taking an action has consequences that are 

unintended and invisible but cause trouble 
later. 

The system tells the lea rner/player to do 
something that is clearly inappropriate. 

The system provides no support or guidance 
for overall goals (e.g. "winning” 

"typing a letter”) 

Figure 10: Typical Problems Faced by Users - Carroll [1982a] 



Slipperiness 



Side effects 



Paradox 
Laissez-fai re 
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The problems noted by Carroll can be formidable obstacles in learn- 
ing to use a computer system. Some people regard them as so intimi- 
dating that they are never able to master the machine. Others regard 
them as a challenge and even become compulsive about responding to it. 
Carroll offers a series of suggestions for system design to reduce the 
problems noted in Figure 10. These suggestions are given in Figure 
11. Carroll regards his work as preliminary. These results were pub- 
lished in the IEEE Computer , and seemed generally interested in stimu- 
lating thought on software design issues. 



Responsiveness 


When you do something, you get some 
feedback (at least informational). 


Benchmarks 


You can tell where you are within a 

given episode or session. Yoi^ have the 
means for assessing achievement and 
development of skill. 







Acceptable uncertainty Being less than fully confident of your 

understanding and expertise is OK. 

Safe Conduct You cannot do anything too wrong. 

Learning by doing You do so that you can learn to do; you 





design a plan; you do not merely follow 
a recipe. 


Opportunity 


Most of the things you learn to do work 

everywhere. You can reason out how to 
do many other things. 


Taking charge 


If progress stagnates, something new is 
suggested or happens spontaneously. 


Control 


You are in control or at least have the 
illusion of being in control. 



Figure 11: Exploratory Environment Cha racteristics - Carroll [1982a] 

Malone [1981] is studying the same kind of issues as Carroll. His 
work also focuses on the relationship between computer games and more 
conventional computer programs. He is interested in what makes games 
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so intriguing and whether these features of the game interface could be 
transferred to other programs. He ran subjects through a series of 
learning game experiments and tried to abstract features of the game 
that worked best. From this, he developed a set of heuristics for de- 
signing enjoyable interfaces. These are given in Figure 12. 

This work with exploratory environments is trying to find out how 
people solve problems in a system where there are few formal clues to 
proper behavior. This has always been a feature of computer systems. 
The manual never tells you everything there is to know about a system. 
It simply cannot. The combinatorics render that impossible. It has al- 
ways been true that some people are inherently better explorers of this 
computer environment than others. But until recently, there has been 
no research into why this might be so. Microcomputers and video 
games have made this a more pressing question. The video games show 
that exploration of complex environments is feasible and even a reason- 
able thing to do. There are few manuals to video games. The wide- 
spread use of micros even by non-technical individuals makes a better 
understanding of exploration necessary. 

The work on exploration in the references is interested primarily in 
the interface design question. But, there is a flip side to this that is 
of interest in this research. How can we teach people to be better ex- 
plorers? Is this a teachable skill? This is the same question (applied 
to a narrower domain) that motivates this whole report. As computer's 
become more pervasive, this is a question that deserves research. 
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I. Challenge 



A. Goal. Is there a clear goal in the activity? Does the 
interface provide performance feedback about how close 
the user is to achieving his goal? 

B. Uncertain outcome. Is the outcome of reaching the goal 
uncertain? 

1. Does the activity have a variable difficulty level? 

For example, does the interface have successive 
layers of complexity? 

2. Does the activity have multiple level goals? For 

example, does the interface include scorekeeping? 

II. Fantasy 

A. Does the interface embody emotionally appealing 
fantasies? 

B. Does the interface embody metaphors with physical or 
other systems that the user already understands? 

III. Cu riosity 

A. Does the activity provide an optimal level of 
informational complexity? 

1. Does the interface use audio and visual effects: 

(a) as decoration, (b) to enhance fantasy and 
(c) as a representation system? 

2. Does the interface use randomness in a way that adds 

variety without making tools unreliable? 

3. Does the interface use humor appropriately? 

B. Does the interface capitalize on the users' desire to 
have "well -formed" knowledge structures? Does it 
introduce new information when users see that their 
existing knowledge is (1) incomplete, (2) inconsistent 
or (3) un parsimonious? 



Figure 12: Interface Design Heuristics - Malone [1981] 
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5.4 HUMANS AS PROBLEM SOLVERS 



The most comprehensive theory of human problem solving behavior 
is that of Newell and Simon. They worked this theory out over many 
years. The most complete explanation of the theory and its justification 
and sources is found in their book Human Problem Solving. Theirs is 
an information processing view of the psychology of problem solving. 
The model is computer-like in its assumptions about humans. 

The basic components of the model are: 



1 . 


Receptors and Effectors 


2. 


Processor 




3. 


Short Term Memory 


(STM) 


4. 


Long Term Memory 


(LTM) 


5. 


External Memory 





Data about the environment is gathered by the receptors. It is held in 
STM and is immediately available for processing. Experimental evidence 
[Miller, 1956] indicates that the STM is limited in its capacity. The 
STM corresponds to temporary buffers in computing. More recent psy- 
chological research has also suggested the existence of an Intermediate 
Term Memory (ITM). This memory controls our daily lives holding our 
memory of things like our daily schedule, appointments, and so on. 
This would correspond to the core memory in a computer system if it 
exists. Beyond this, there is the long term memory. The LTM pre- 
sumably is large enough to store the memories of a lifetime. In a com- 
puter system, the analogy is the on-line mass storage. The EM is 
whatever memory aids we choose to use (e.g. paper notes). The com- 
puter analogy might be off-line archival storage. 

The processor corresponds to the CPU plus program in a computer. 
It seems to operate as a serial processor although this is hard to define 
exactly. It is obvious that there is a limited degree of parallelism in 
neurological processes, but the basic control seems to be serial. Pro- 
cessing seems to have an internal clock time of about 40 milliseconds 
between elementary operations (about 250 operations per second) . The 
comparable rate for computers is between 10,000 and 100,000 times fast- 
er. The basic operation is a simple store and compare. The decision 
making process seems to behave like a production rule system. Inter- 
estingly enough, this production rule approach is the same one used in 
the "Fifth Generation" for implementing expert systems in computers 
[Clocksin and Mellish, 1981], 
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The model is mostly a theoretical construct based on a synthesis of 
research done by many psychologists. The approach used in testing 
many of their theories included computer simulation. It is possible to 
implement this model on a computer and let the computer help work out 
the implications of the theory. This work has had at least as much im- 
pact on computer science as it has on psychology. 

The educational implications of the Newell-Simon model are less 
clear. It is a descriptive not a normative model. The obvious parts of 
the model to focus on in improving general problem solving ability are 
the Processor and LTM components. The difference between good 

problem solvers and poor ones is probably in the processing rules they 
use for information. If good processing rules can be discovered and 
taught then there may be real utility to teaching general problem solv- 
ing. The LTM component could be improved by teaching improved re- 
call and structuring of knowledge. All this is easier to do with ma- 
chines than people. Perhaps this is why this theory has had more 
impact on computer science than on education. 
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6 



DIRECTIONS FOR FUTURE RESEARCH AND 
DEVELOPMENT 



The usefulness of teaching general problem solving is not fully es- 
tablished. The literature surveyed in this research shows some interest 
and activity in the area. Compared to thirty years ago, there has been 
a sizeable increase in interest. This increase was initially started by 
work in artificial intelligence and cognitive psychology in the 1950's. 
In the 1970's and 1980’s, the influence began to be felt , i n education. 
In addition, the growth of interest in artificial intelligence and expert 
systems is likely to mean increasing stress on the study of problem 
solving . 

The value of teaching general problem solving is likely to remain 
unproved for some time. It is unclear whether the subject can be 
taught successfully. All during our education, we learn to solve specific 
problems, not general ones. Our education forces us to think of do- 
main specific problem solving. There may be transfer of problem solv- 
ing skills from one area to another (this is the normal justification for 
teaching liberal arts), but this remains unproved as well. The litera- 
ture in this area is too sketchy to be able to give a definitive answer. 



6.1 PROBABABLE USEFULNESS OF TEACHING PROBLEM SOLVING 

Much of the discussion and activity in the teaching of general prob- 
lem solving would appear to be based only on the hope that it can help. 
Some research is openly critical of the usefulness of general problem 
solving instruction [Post and Brennan, 1976], Other work is more op- 
timistic [Reif and Heller, 1982; Thorson, 1977] but it is still largely 
unvalidated. During our conversations with Hayes in San Diego, he 
stated that there is little or no validation of the work he and others 
have done. What validation exists is casual, based on fragmentary 
feedback from former students. He would like to conduct formal valida- 
tion of the course, but has not had the time or resources so far to do 
this . 
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It would be useful for Naval officers to have some exposure to the 
theory of problem solving if only because this area is a basis for the 
so called ’’expert systems” that are becoming become increasingly impor- 
tant. A background in the techniques used in general problem solving 
and artificial intelligence would be helpful in understanding these sys- 
tems. This could be useful even if the student's own problem solving 
ability were not substantially improved. 



6.2 TEACHING PROBLEM SOLVING 

The inescapable fact remains that problem solving is wedded to a 

choice of domain. It is difficult for people to get from their domain 

specific knowledge to any kind of overview of the problem solving pro- 
cess. It has only been comparatively recently that people did research 

on the subject of problem solving in general apart from ^ specific do- 
main . 

Much of the material that is supposed to be ’’general” in fact begins 
to seem domain specific when you look at it closely. It usually includes 
such things as thinly disguised logical puzzle or mathematical problems. 
Hayes’ book has many problems of this type. This approach is prob- 
ably useful for well defined problem. The well defined problems may be 
more typical of problems like computer program debugging, electrical or 
mechanical troubleshooting, etc. These problems are ones in which we 
already have a problem and a representation . The rules for manipulat- 
ing the representation are well known. For this kind of problem, 
teaching general search heuristics may well be beneficial. Good problem 
solvers in these domains already know these heuristics, but teaching 
the heuristics to beginners might help shorten the learning time re- 
quired to achieve competence. 

These search heuristics are less likely to be useful where the prob- 
lem is ill-defined. In this type of problem, the first phase of problem 
solving is a design component. It is necessary to decide what the 
problem is and to select or create a representation for it. It would 
probably be more useful to teach techniques for selecting, defining and 
representing problems. The approaches used by DeBono and others 
might be useful here. The elaborate search heuristics may be less use- 
ful for ill-defined problems. Many management problems would best be 
characterized as ill-defined. 
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6.3 VALIDATING RESULTS 



For any work in teaching general problem solving, a major problem 
is going to be validation of the results. We were not able to find any 
generally accepted measures of problem solving ability applicable to a 
population of college educated adults. The work we came across was 
geared toward grade and high school students. This work also tends 
to be oriented toward well-defined rather than ill-defined problems. 
These problems are easier to measure and easier to achieve agreement 
on standards for success. 

If one wishes to teach generic problem solving as a basic subject at 
this level, it will be necessary to develop measures of problem solving 
ability. This will not be easy to do. It may well prove impossible to 
find measures that do not discriminate in favor of cultural or domain 
specific skills. It has proven difficult to create measures of general 
intelligence. It is likely to be even more difficult to create widely ac- 
ceptable measures of general problem solving ability. 



6.4 FUTURE WORK IN TEACHING GENERAL PROBLEM SOLVING 

General problem solving may be too nebulous a term for the things 
we have been discussing here. A better term might be "learning strat- 
egies" since this is the focus of work like Hayes and Rubenstein. It 
seems that future work in this area should proceed slowly and deliber- 
ately. It should involve both curriculum development and basic re- 

search. The curriculum development could provide a course to serve as 
a vehicle for testing theories turned up in research. The available lit- 
erature does not support the idea that general problem solving is a 
subject suitable for inclusion in standard training sequences or core 
courses . 

One point that Hayes emphasized strongly was that it was not 
enough to lay out principles of general problem solving and expect the 
students to pick them up. Good examples and practice are required. 
This is one reason that it is likely to be difficult to set up a "general" 
problem solving course. Most course material is oriented to demonstrat- 
ing the techniques involved in a particular discipline. There is usually 
little effort made to illustrate general principles or give help in apply- 
ing them. New course material would have to be developed. 

A course in general problem solving would have to be carefully de- 
signed. Adult students are more likely to respond to domain specific 
material. This would make them feel that the course was relevant to 
their interests and probably make them more enthusiastic about learning 
the material . 
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6.5 DIRECTIONS FOR FUTURE RESEARCH 



There is a need for both theoretical and applied research in problem 
solving. Topics of interest include: 

1. Design of measures of problem solving skills. Most measures in 

use currently are aimed at younger students. They are also 
aimed at well-defined problems and domain specific skills. Some 
broader measures of problem solving ability are required. 

2. Design of course modules in problem solving covering both do- 

main specific and general skills. The needs of the Navy in- 
volve both education and training. Practice with courses ap- 
propriate to both areas is required. 

3. Experiments where the usefulness of teaching problem solving 

skills is tested. Once the courses and measures of ability are 
in place, they must be debugged. 

4. Studies of computers and human problem solving. These should 

focus on the computer as a problem environment and ways in 
which the computer can aid human problem solving. The per- 
vasiveness of computers in our environment makes it essential 
that we develop a better understanding of the ways in which 
people use them. 
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